The feasibility of ideography as an empirical question for a science representational systems design.

The possibility of ideography is an empirical question. Prior examples of graphic codes do not provide compelling evidence for the infeasibility of ideography, because they fail to satisfy essential cognitive requirements that have only recently been revealed by studies of representational systems in cognitive science. Design criteria derived from cognitive principles suggest how effective graphic codes may be engineered.

Multi-touch Interaction Data Analysis System (MIDAS) for 2-D tactile display research.

The study of haptic perception and cognition requires data about how humans interact with tactile surfaces in the context of performing cognitive tasks. MIDAS is a set of three tools for the digital capture, coding, analysis, and interpretation of time-series, multitouch, interactive behaviors on a tactile surface. The MIDAS-logger uses the current screen technology of tablet computers to capture touches (up to ten fingers at high spatial and temporal resolution) through conventional tactile graphics that are overlaid on the screen. The MIDAS-analyser is a software program for the qualitative and quantitative analysis of MIDAS-logger touch data, which includes a fully interactive visualization of the data and a yoked display of a conventional simultaneous video recording made of the interactions. MIDAS-tactile protocol analysis (TPA) provides a scheme and a method to enable the rich coding and interpretation of tactile behaviors over multiple spatial and temporal scales. The efficacy of MIDAS was assessed against a set of criteria drawn from the successes and limitations of prior approaches to the study of tactile interactions. To demonstrate the functions of MIDAS, its three components were used to capture, analyze, code, and interpret the behavior of an experienced user and an inexperienced user of tactile graphics as they performed a shape-matching task.

Combinations of Simple Mechanisms Explain Diverse Strategies in the Freehand Writing of Memorized Sentences.

Individual differences in the strategies that control sequential behavior were investigated in an experiment in which participants memorized sentences and then wrote them by hand, in a non-cursive style. Thirty-two participants each wrote eight sentences, which had hierarchical structures with five levels. The dataset included over 31,000 letters. Despite the deliberately constrained nature of the task and stimuli, 23 patterns of behavior were identified from the durations of pauses that occurred before the inscription of letters at four chunk levels, spanning letters, words, phrases, and sentences. A critical path task analytic model, Graphical Production of Memorized Sentences (GPoMS), shows that the control of writing relies on cues that continuously switch between motor actions and chunk retrievals in a just-in-time fashion at the level of letter information. GPoMS explains the individual differences in terms of variants of a motor production mechanism and variants of a chunk retrieval mechanism, which involve varying degrees of parallelism between cognitive actions and motor actions. A graphical technique for constructing GPoMS models was developed that enabled the estimation of ongoing working memory demands during production.

Probably good diagrams for learning: representational epistemic recodification of probability theory.

The representational epistemic approach to the design of visual displays and notation systems advocates encoding the fundamental conceptual structure of a knowledge domain directly in the structure of a representational system. It is claimed that representations so designed will benefit from greater semantic transparency, which enhances comprehension and ease of learning, and plastic generativity, which makes the meaningful manipulation of the representation easier and less error prone. Epistemic principles for encoding fundamental conceptual structures directly in representational schemes are described. The diagrammatic recodification of probability theory is undertaken to demonstrate how the fundamental conceptual structure of a knowledge domain can be analyzed, how the identified conceptual structure may be encoded in a representational system, and the cognitive benefits that follow. An experiment shows the new probability space diagrams are superior to the conventional approach for learning this conceptually challenging topic.

Modeling the effect of task and graphical representation on response latency in a graph reading task.

We report an investigation into the processes involved in a common graph-reading task using two types of Cartesian graph. We describe an experiment and eye movement study, the results of which show that optimal scan paths assumed in the task analysis approximate the detailed sequences of saccades made by individuals. The research demonstrates the computational inequivalence of two sets of informationally equivalent graphs and illustrates how the computational advantages of a representation outweigh factors such as user unfamiliarity. We describe two models, using the ACT rational perceptual motor (ACT-R/PM) cognitive architecture, that replicate the pattern of observed response latencies and the complex scan paths revealed by the eye movement study. Finally, we outline three guidelines for designers of visual displays: Designers should (a) consider how different quantities are encoded within any chosen representational format, (b) consider the full range of alternative varieties of a given task, and (c) balance the cost of familiarization with the computational advantages of less familiar representations. Actual or potential applications of this research include informing the design and selection of appropriate visual displays and illustrating the practice and utility of task analysis, eye tracking, and cognitive modeling for understanding interactive tasks with external representations.